223 research outputs found

    ISLTranslate: Dataset for Translating Indian Sign Language

    Full text link
    Sign languages are the primary means of communication for many hard-of-hearing people worldwide. Recently, to bridge the communication gap between the hard-of-hearing community and the rest of the population, several sign language translation datasets have been proposed to enable the development of statistical sign language translation systems. However, there is a dearth of sign language resources for the Indian sign language. This resource paper introduces ISLTranslate, a translation dataset for continuous Indian Sign Language (ISL) consisting of 31k ISL-English sentence/phrase pairs. To the best of our knowledge, it is the largest translation dataset for continuous Indian Sign Language. We provide a detailed analysis of the dataset. To validate the performance of existing end-to-end Sign language to spoken language translation systems, we benchmark the created dataset with a transformer-based model for ISL translation.Comment: Accepted at ACL 2023 Findings, 8 Page

    PULSAR DETECTION SYSTEM USING RADIO TELESCOPE

    Get PDF
    Radio astronomers and Researchers have detected numerous neutron stars in our galaxy, and they also predicted the Existence of many more neutron stars in space. Pulsars are very peculiar, yet almost inscrutable celestial objects. This is an object which is impelling radiation into space closest to the speed of light. Neutron stars are the most interesting galactic bodies to mankind. The things that hold us during the whole study are the fascinating properties of pulsar i.e. high density, a small diameter, strong gravity, and strong magnetic field. As the peculiar properties and the extreme nature of pulsar continue to disclose this catches the attention of Astronomers. Pulsars are distant objects. So, it is very tedious job to capture the radiations coming from it for this we have designed a system which consist of an Antenna, Filters, Amplifiers and Receiver. The signal we capture through the antenna will undergo signal processing to extract the Pulse which is buried in noise. The techniques used here are the fast-folding algorithm (FFA) and Fast Fourier transform (FFT) are explained along. By this whole study to building a system and performed signal processing and obtained the Pulse

    ScriptWorld: Text Based Environment For Learning Procedural Knowledge

    Full text link
    Text-based games provide a framework for developing natural language understanding and commonsense knowledge about the world in reinforcement learning based agents. Existing text-based environments often rely on fictional situations and characters to create a gaming framework and are far from real-world scenarios. In this paper, we introduce ScriptWorld: a text-based environment for teaching agents about real-world daily chores and hence imparting commonsense knowledge. To the best of our knowledge, it is the first interactive text-based gaming framework that consists of daily real-world human activities designed using scripts dataset. We provide gaming environments for 10 daily activities and perform a detailed analysis of the proposed environment. We develop RL-based baseline models/agents to play the games in Scriptworld. To understand the role of language models in such environments, we leverage features obtained from pre-trained language models in the RL agents. Our experiments show that prior knowledge obtained from a pre-trained language model helps to solve real-world text-based gaming environments. We release the environment via Github: https://github.com/Exploration-Lab/ScriptWorldComment: Accepted at IJCAI 2023, 26 Pages (7 main + 19 for appendix

    Shapes of Emotions: Multimodal Emotion Recognition in Conversations via Emotion Shifts

    Full text link
    Emotion Recognition in Conversations (ERC) is an important and active research area. Recent work has shown the benefits of using multiple modalities (e.g., text, audio, and video) for the ERC task. In a conversation, participants tend to maintain a particular emotional state unless some stimuli evokes a change. There is a continuous ebb and flow of emotions in a conversation. Inspired by this observation, we propose a multimodal ERC model and augment it with an emotion-shift component that improves performance. The proposed emotion-shift component is modular and can be added to any existing multimodal ERC model (with a few modifications). We experiment with different variants of the model, and results show that the inclusion of emotion shift signal helps the model to outperform existing models for ERC on MOSEI and IEMOCAP datasets.Comment: 13 pages, Accepted at Workshop on Performance and Interpretability Evaluations of Multimodal, Multipurpose, Massive-Scale Models, COLING 202

    U-CREAT: Unsupervised Case Retrieval using Events extrAcTion

    Full text link
    The task of Prior Case Retrieval (PCR) in the legal domain is about automatically citing relevant (based on facts and precedence) prior legal cases in a given query case. To further promote research in PCR, in this paper, we propose a new large benchmark (in English) for the PCR task: IL-PCR (Indian Legal Prior Case Retrieval) corpus. Given the complex nature of case relevance and the long size of legal documents, BM25 remains a strong baseline for ranking the cited prior documents. In this work, we explore the role of events in legal case retrieval and propose an unsupervised retrieval method-based pipeline U-CREAT (Unsupervised Case Retrieval using Events Extraction). We find that the proposed unsupervised retrieval method significantly increases performance compared to BM25 and makes retrieval faster by a considerable margin, making it applicable to real-time case retrieval systems. Our proposed system is generic, we show that it generalizes across two different legal systems (Indian and Canadian), and it shows state-of-the-art performance on the benchmarks for both the legal systems (IL-PCR and COLIEE corpora).Comment: Accepted at ACL 2023, 15 pages (12 main + 3 Appendix

    Generalized Product-of-Experts for Learning Multimodal Representations in Noisy Environments

    Get PDF
    A real-world application or setting involves interaction between different modalities (e.g., video, speech, text). In order to process the multimodal information automatically and use it for an end application, Multimodal Representation Learning (MRL) has emerged as an active area of research in recent times. MRL involves learning reliable and robust representations of information from heterogeneous sources and fusing them. However, in practice, the data acquired from different sources are typically noisy. In some extreme cases, a noise of large magnitude can completely alter the semantics of the data leading to inconsistencies in the parallel multimodal data. In this paper, we propose a novel method for multimodal representation learning in a noisy environment via the generalized product of experts technique. In the proposed method, we train a separate network for each modality to assess the credibility of information coming from that modality, and subsequently, the contribution from each modality is dynamically varied while estimating the joint distribution. We evaluate our method on two challenging benchmarks from two diverse domains: multimodal 3D hand-pose estimation and multimodal surgical video segmentation. We attain state-of-the-art performance on both benchmarks. Our extensive quantitative and qualitative evaluations show the advantages of our method compared to previous approaches.Comment: 11 Pages, Accepted at ICMI 2022 Ora

    Urban Growth in Himalaya: Understanding the Process and Options for Sustainable Development <Article>

    Get PDF
    During recent years, urbanization has emerged as one of the important drivers of global environmental change transforming mountain regions, particularly in developing countries where the process of urban-growth has been fast but mostly unsystematic, unplanned and unregulated. Himalaya representing tectonically alive, densely populated, and one of the most marginalized mountain regions of the world has experienced rapid urban growth during last three decades. More recently, comparatively less accessible areas have also come under the process of rapid urbanization mainly owing to improved road connectivity, publicity and marketing of new tourist sites and the resultant growth of domestic as well as international tourism; development of horticulture; economic globalization and gradual shift from primary resource development practices to secondary and tertiary sectors; and due to absence of urban land use policy. Consequently, there has been tremendous increase in size, area, number and complexity of urban settlements in the Himalaya resulting into the expansion of urban processes (i.e., expansion of urban land use in surrounding agricultural zone, forests and rural environments) as well as increase in the intensity of urban land use (i.e., increase in the density of covered area, density of building, and increase in the density of population) within the towns. On the one hand, the growing urban areas in high mountain are now serving as the centres of growth by creating opportunities of employment, variety of socio-economic services and expansion of infrastructure; and contributing towards the development of their vast hinterland through trickledown effect; while on the other, the sprawling urban growth in fragile mountains has disrupted the critical ecosystem services. The speedy and unplanned urbanization has perturbed the hydrological regimes of Himalayan watersheds and reduced ground water recharge, and decreased the availability of water for drinking, sanitation and crop production; depleted forests and biodiversity; increased risks of natural hazards and disasters both in urban areas as well as in their peri-urban zones; and increased vulnerability of mountain inhabitants to water, food, livelihood and health insecurity. Moreover, climate change has stressed urban ecosystems by increasing the frequency, severity and intensity of extreme weather events. As in other parts of the world, urban growth cannot be stopped or reduced in Himalaya, but it can be steered in a more sustainable manner through an integrated urban-rural land use planning. Effective land use policies need to be evolved and implemented for the protection and conservation of forests, biodiversity, water resources and agricultural land
    • …
    corecore